The Resource Theory of Quantum States Out of Thermal Equihbrium 
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The ideas of thermodynamics have proved fruitful in the setting of quantum information theory, in 
particular the notion that when the allowed transformations of a system are restricted, certain states 
of the system become useful resources with which one can prepare previously inaccessible states. 
The theory of entanglement is perhaps the best-known and most well-understood resource theory in 
this sense. Here we return to the basic questions of thermodynamics using the formalism of resource 
theories developed in quantum information theory and show that the free energy of thermodynamics 
emerges naturally from the resource theory of energy-preserving transformations. Specifically, the 
free energy quantifies the amount of useful work which can be extracted from asymptotically-many 
copies of a quantum system when using only reversible energy-preserving transformations and a 
thermal bath at fixed temperature. The free energy also quantifies the rate at which resource 
states can be reversibly interconverted asymptotically, provided that a sublinear amount of coherent 
superposition over energy levels is available, a situation analogous to the sublinear amount of classical 
communication required for entanglement dilution. 



Quantum resource theories are specified by a restric- 
tion on the quantum operations (state preparations, 
measurements, and transformations) that can be imple- 
mented by one or more parties. This singles out a set 
of states which can be prepared under the restricted op- 
erations. If the parties facing the restriction acquire a 
quantum state outside the restricted set of states, then 
they can use this state to implement measurements and 
transformations that are outside the class of allowed op- 
erations, consuming the state in the process. Thus, such 
states are a resource. 

A few prominent examples serve to illustrate the idea: 
if two or more parties are restricted to communicating 
classically and implementing local quantum operations, 
then entangled states become a resource [l[ ; if a party is 
restricted to quantum operations that have a particular 
symmetry, then states that break this symmetry become 
a resource ; if a party is restricted to preparing states 
that are completely mixed and performing unitary oper- 
ations, then any state that is not completely mixed ^.e. 
any state that has some purity, becomes a resource [5[- 

In this Letter we develop the quantum resource the- 
ory of athermal states. This provides a useful new for- 
mulation of nonequilibrium thermodynamics for finite- 
dimensional quantum systems, and allows us to apply 
new mathematical tools to the subject. The restricted 
class of operations which defines our resource theory are 
those that can be achieved through energy-conserving 
unitaries and the preparation of any ancillary system in a 
thermal state at temperature T, as first studied by Janz- 



ing et al. [6| in the context of Landauer's principle. Here 
the ancillary systems can have an arbitrary Hilbert space 
and an arbitrary Hamiltonian, and may be described as 
having access to a single heat bath at temperature T. 
States that are not in thermal equilibrium, that is, which 
are athermal, are the resource in this approach. 

Quantum resource theories provide answers to ques- 
tions such as: how does one measure the quality of dif- 
ferent resource states? Can one particular resource state 
be converted to another deterministically? If not, can it 
be done nondeterministically, and if so with what prob- 
ability? What if one has access to a catalyst? A par- 
ticularly fundamental problem, addressed in this Letter, 
is to identify the equivalence classes of states that are 
reversibly interconvertible in the limit of asymptotically- 
many copies of the resource and to determine the rates of 
interconversion. We show that all nonthermal states are 
reversibly interconvertible asymptotically and that the 
free energy of a state is the quantity governing the rate 
of interconversion. 

It is worth pausing to consider the merits of the re- 
source theory approach. The examples of entanglement, 
asymmetry and purity demonstrate that studying a given 
property of quantum states as a resource is a very ef- 
ficient way of coming to understand it better. Nai've 
intuitions and preconceptions about such properties are 
typically replaced by a more refined view through the 
simple process of solving the variety of quantitative and 
operationally well-defined problems presented by the re- 
source paradigm. Another feature of such an approach 
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is its generality: rather than considering the behavior 
of the property of interest for some particular system 
with particular dynamics (as is typical in thermodynam- 
ics), one considers instead the fundamental limits that 
are imposed by the restriction defining the resource and 
the laws of quantum theory. 

On the practical side, a better understanding of a given 
resource helps to determine how best to implement the 
tasks that make use of it, and, more fundamentally, such 
an understanding may serve to clarify what sorts of re- 
sources are even relevant for a given task 0. Finally, 
a resource theory approach can provide a framework for 
organizing, synthesizing, and consolidating the results in 
a given field, and thermodynamics is a field that is par- 
ticularly in need of such a framework In particular, 
studying the interconvertibility of finite resources leads 
to useful notions of free energy in that shown 
by two of us in Similar results were reported by 
Aberg who investigated the work extractable from 
finite resources. 

Allowed Operations & Resource States. — We now de- 
fine the restricted class of operations and the resource 
states more precisely. Given a quantum system s with 
Hilbert space Hs and Hamiltonian Hg, the restricted 
operations arc the completely-positive trace-preserving 
(CPTP) maps £ : C (Hs) C (Hs) of the form 



(1) 



Here a is an arbitrary ancillary system with Hilbert 
space Tia and Hamiltonian Ha, 7a is the thermal 
(Gibbs) state at inverse temperature /3 = l/fcsT, 7^ = 
e^'^^"/Tra (e~'^^°) , and V is an arbitrary unitary op- 
eration on Hs <E) Ha that satisfies [V, H] = 0, where 
H = Hs (E) la + Is 'S^ Ha is the sum of the free Hamil- 
tonians of system and ancilla. Any state p ^ 7 is a 
resource state in system s. While we here consider the 
case that input and output systems and their Hamiltoni- 
ans are identical, this framework can be easily extended 
to the more general done by Janzing et al. [6[. 

The restricted class of operations is singled out as par- 
ticularly relevant for thermodynamics because the oper- 
ations it includes cannot, on their own, be used to do 
work. Moreover, it is not too difficult to see that various 
different kinds of nonthermal states can be used, via the 
restricted class of operations, to do work: for thermal 
states at a temperature T', distinct from T, work can 
be drawn using a heat engine (such states simulate hav- 
ing a second heat bath at a different temperature); for 
pure states within a degenerate energy eigenspace, work 
can be drawn using a Szilard engine ; for pure energy 
eigenstates, work can be drawn directly by an energy- 
conserving unitary. One is led to expect that one can 
extract work form any athermal state. We shall show 
that asymptotically this is indeed the case. 

Note that within a resource theory framework, any in- 
teraction between the system and ancilla is assumed to 



be under the control of the experimenter and is therefore 
included in V . However, as described in the Appendix, 
the operations needed to establish our main result are 
mappings between macroscopic observables and do not 
require fine-grained control. The Appendix also shows 
that a number of different classes of operations for ther- 
modynamics are in fact equivalent. 

Resource Interconvertibility & Free Energy. — A central 
question in any resource theory is that of resource in- 
terconversion: Which resources can be transformed into 
which others, and how easily? Generally there exists a 
partial order, or quasiorder, of resources: We say A> B 
if resource A can be transformed into B using the allowed 
operations. Functions which respect this quasiordcr are 
known as resource monotones. For instance, the rela- 
tive entropy of entanglement is a well-known resource 
monotone in the resource theory of local operations and 
classical communication (LOCC) 

Here we are interested in determining the optimal rate 
R{A~>B) at which resource A can generate resource B, 
in the limit of an infinite supply of A. A simple argument, 
going back to Carnot [l^ , implies that if the transforma- 
tion is reversible in the sense that R{B A) ^ 0, then 
the rate at which two resources can be reversibly intcr- 
convcrtcd must achieve the optimal rate. Otherwise, it 
would be possible to generate arbitrary amounts of a re- 
source state from a small number via cyclic transforma- 
tions to and from another resource state. 

That reversible interconversion is optimal (when possi- 
ble) also gives a simple means of characterizing the inter- 
conversion rate by using a "standard" reference resource. 
Consider a transformation from A to B which proceeds 
via the standard resource C: A ^ C ^ B. Compos- 
ing this with B ^ A must give a combined transforma- 
tion of unit rate, again to avoid the possibility of spon- 
taneously generating resources. Composing the rates, we 
have RiA C)R{C B)R{B A) ^ 1, or 



RiA -^B) = 



RjA C) 
R{B^Cy 



(2) 



using the fact that R[A B)R{B ^ A) = 1. With this 
framework, we only need to define the relative entropy 
D {p\\-f) ~ Tr[/9(log/9 — log 7)] to state the main result of 
this Letter. 

Theorem 1 Asymptotic interconversion at nonvanish- 
ing rate is possible between all states p and a of system 
with fixed Hamiltonian. Furthermore, the optimal rate is 
given by 



R{p a) 



D{a\\jy 



(3) 



Simple calculation reveals that D {p\\'-f) = l3Fi3{p) — 
PFi3["f), where Fp{p) = {H)p — TS{p) is the free energy. 
Thus, the free energy directly determines the optimal 
rate of resource interconversion in our resource theory. 
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The proof of this result proceeds in two steps. First, 
it is relatively simple to establish that if asymptotic in- 
terconversion is possible at nonvanishing rate, then the 
interconvcrsion rate must be the expression given. The 
more difficult part is then to establish that interconvcr- 
sion is possible for any pair of states. 

The rate expression Eq. ([3]) follows almost immediately 



from [13| , Theorem 1 (see also [IJ] , Theorem 4) once re- 
versibility of transformation has been shown. This re- 
sult states that any asymptotically-continuous resource 
monotone / determines the interconvcrsion rate via its 
regularized version f°°{p) = lim„_j.oo -fip^"") as R{p ^ 
p') = f°°{p)/ f°°{p')j provided this quantity is nonzero 
and finite. 

To make use of this theorem we need to show that one 
can define f{p) — D {p\\j) using the relative entropy and 
that we can interconvert states reversibly. The relative 
entropy is a resource monotone because it is contractive 
under all completely-positive maps, not just the allowed 
operations. Further, regularization is unnecessary in this 
case because the thermal state on n systems is just n 
copies of the thermal state on one system, and therefore 



nf{p). Finally, extensivity 



of energy implies asymptotic continuity of the relative en- 
tropy using Proposition 2 of [3l , the derivation of which 
wc leave to the Appendix. 

Extensivity is more important than it might initially 
appear. For instance, the relative entropy D {-jUp) is 
also a resource monotone, but does not lead to the in- 
terconversion rate as the extensivity argument does not 
go through and this quantity fails to be asymptotically 
continuous. Nonetheless, the relative entropy D (jUp) 
as a monotone plays an important role in the resource 
requirements of creating low-tempcrature states @. 

Reversible Interconversion of Arbitrary States. — Now 
it remains to show that all states are interconvertible at 
the rate given in Theorem [TJ We do this by construct- 
ing protocols for both distillation of resource states into 
a standard state and formation of resource states from 
standard states. The standard state is chosen to have 
energy but no entropy so as to represent available work. 

For purposes of exposition, we make two simplifica- 
tions which nevertheless capture the essential aspects of 
the problem. The more general details are left to the 
Appendix. First, we consider resources having just two 
nondegenerate energy levels, i.e. qubits. Second, we as- 
sume that the resource states are stationary, meaning 
[p, H] = and therefore they are diagonal in the energy 
eigenbasis. Such states are called quasiclassical. 

Both distillation and formation protocols must satisfy 
three requirements, up to error terms smaller than 0{n): 
(1) energy conservation, (2) unitarity, and (3) equal- 
ity of input and output dimensions. Without loss of 
generality, wc may take the system Hamiltonian to be 
H = -E^o X)i |1) (1| f'^'" some energy Eq, where the sum 
runs over all involved qubits. 



Wc begin the distillation protocol with £ copies of the 
Gibbs state 7 and n copies of the resource p, where p = 
diag(l— for arbitrary < p < 1 and 7 = diag(l— g, q) 



-l3Eo 



/{I + e ^^°). The aim is to effect a trans- 

(fc) ^ ^i^^(g,rn 



for q 

formation of the form 7*^ 
energy-conserving unitary, such that m is as large as pos- 
sible. The resulting exhaust state cr of fc systems is arbi- 
trary, though as shown in the Appendix, the optimality 
of the protocol implies that it has near-Gibbs form. We 
denote by i? = ^ the rate of distillation and e = j the ra- 
tio between initial resource states and Gibbs states. The 
Gibbs states arc free, so we allow for e as n — > 00. 

We now use the fact that for large n, p*^" consists of 
mixtures of strings with roughly np Is. The number t of 
Is in a string is known as its type, and more concretely 
we have that, to an error which vanishes as n — >■ cx), 



P 



6$n 



(4) 



Here the t summation runs over str ong ly typical types, 
the types for which t = np±0{^/n) [16[, and Pt denotes 
projector onto the type t. An entirely similar statement 
holds for 7®^. For simplicity we shall first pretend that 
both 7*^^ and p®" consist of a single type and subse- 
quently show how to extend the argument to more types. 

Thus, we begin with the tensor product of two types, 
one coming from the resource state and the other the 
Gibbs state. This produces an equal mixture of strings 
of length n + i, in which each string consists of two sub- 
strings: the first having £q Is and the second np Is. 
There are roughly 2'^2(<j) x 2"^2(p) g^ci^ strings, where 
H2{p) = ~plog2?' — (1 — p) log2(l — p) is the binary en- 
tropy. 

Now consider a transformation which maps these 
strings to new strings having at least m Is in the right- 
most positions. 



oo...oii_^oo...on_^^ 0...00 

np rk m 

k 

where k = m + n — £ \s conservation of dimension, and 
r and m are to be determined. First, r is fixed by the 
conservation of energy, which requires that the number of 
Is is conserved. Hence £q + np = rk + m. Then unitarity 
requires that there are at least as many strings of length 
k with rk Is as the number of initial strings: 2^^^^''^ > 
2tH(q)+nH[p) _ Roughly spcakiug this is conservation of 
entropy. Using these three conditions, we find that the 
transformation is possible if 

H{q) + eH{p) < (1 + e - Re)H{ \^'P''\ (5) 

1 + e — eR 

We now expand this with respect to e to first order and 
let e — >■ 0. This means the heat reservoir is much larger 
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than the resource systems. As a result we obtain that 
the following rate can be achieved 

Hiq)-H{p) + l3{p-q) ^ D{p\\j) 

H{q) + l3{l-q) i^(|l>(l|||7)' ^' 

establishing one direction necessary for Theorem [TJ 

In the above argument we worked with a single type, 
whereas in actuality the initial state is a mixture of prod- 
ucts of types Qt ^ Pf ■ We thus apply the protocol sepa- 
rately to each type, with the same number m of required 
output excited states, for all types, m fitted to the prod- 
uct of less numerous types (the ones with smallest num- 
ber of Is, i.e. np—0{^/n) and £q— 0(^/1) Is, respectively). 
To carry out our estimates wc need to simultaneously ful- 
fill ^/i <^ m = Rn, in order for R to be achievable, and 
£ ^ n, in order for e — J- 0. Choosing i ~ {Rnf'/^ there- 
fore ensures that our estimate ([6]) will be accurate in the 
limit n — >■ oo. [l7| 

The construction of the formation protocol is similar 
to that of the distillation protocol and is again based on 
considering type transformations satisfying the three re- 
quirements of energy conservation, unitarity, and dimen- 
sion conservation. The major difference is that whereas 
the ideal distillation output is simply the fixed-type state 
jl)*^™, the ideal formation output must recreate a good 
approximation to the probabilistic mixture of type classes 
found in p®". 

As outlined in more detail in the Appendix, the for- 
mation protocol is constructed in three stages. The first 
two are similar to the distillation protocol. In the first, a 
given type class of the Gibbs state together with the stan- 
dard resource is transformed into a desired type class of 
the target resource p®". In the second, this construction 
is extended to all the strongly typical types of the Gibbs 
state. Finally, in the third step an additional number 
of Gibbs states are used to probabilistically select which 
type class of the target should be constructed, in order 
to recreate the appropriate distribution over types of the 
target state. In principle this step is irreversible, but 
since the number of type classes grows only polynomi- 
ally with n, the number of extra resources required for 
the third step of the formation protocol vanishes in the 
n — >■ oo limit. The similarity of the first two steps with 
the distillation protocol then ensures that the formation 
protocol achieves the inverse rate. 

The distillation of arbitrary states is related to that of 
stationary states, and we can recycle part of the previous 
distillation protocol. Suppose the resource state has the 
diagonal form p = p|(/)i)(0i|-|-(l-p)|(^2)('A2|, implying an 
average energy of {E) = + (1 -p)|(^2|l)P)i;o. 

In n instances of p the total energy will overwhelmingly 
likely be n{E) ± 0{-\/n). Now imagine projecting the re- 
source state onto the various energy subspaces, destroy- 
ing any coherence between them. Just as in (jj]), p*^" is 
supported almost entirely on its typical subspace, whose 



size not larger than 2"'^('''+'^(^). Thus, the state sup- 
port in every energy subspace is at most this large. 

Now we may imagine applying the same scheme as 
in the previous distillation protocol, creating as many 
copies of |1) as possible. The three conditions now be- 
come k — m + n — £, iqEo + n{E) = rkEo + mEo, 
and 2''^^('') > 2'^^(9)+"'S'('') . An entirely similar deriva- 
tion leads again to the distillation rate found in ([5]). Fi- 
nally, since the distillation operations commute with the 
Hamiltonian, they commute with the projection onto en- 
ergy subspaces. Thus wc may instead imagine that this 
projection is performed after the distillation step. Such 
a projection has no effect on the work systems, while the 
form of the exhaust state is irrelevant, and therefore we 
may dispense with the projection step altogether. 

The formation of arbitrary resource states is more com- 
plicated than their distillation. Strictly speaking, the 
transformation we are interested in is impossible, since 
the inputs are states diagonal in the energy basis and the 
allowed transformations cannot change this fact. How- 
ever, to create the appropriate coherences between en- 
ergy subspaces it suffices to use a small additional re- 
source in the form of a superposition over energy eigen- 
states. This is akin to a similar phenomenon in the re- 
source theory of entanglement where distillation of en- 
tangled states does not require any communication, but 
formation requires an amount sublinear in the number 
of inputs n. This provides an interesting asymmetry be- 
tween formation and distillation as explained in more de- 
tail in the Appendix. The formation process consumes 
only a small amount, sublinear in n, of the extra resource, 
and therefore does not affect the rate calculations. 

Conclusions. — In the preceding we have shown that 
well-known results from thermodynamics can be derived 
quite naturally within the framework of resource theories. 
We should emphasize that although the procedures we 
have described for the conversion of resource states may 
seem quite unnatural from a physical point of view, their 
use is to establish the "in principle" interconversion rate 
given in Theorem [1] Any more realistic reversible trans- 
formation, for instance the Hamiltonian method of [isj . 
will necessarily extract the same amount of work. 

We thank Jochen Rau and Dominik Janzing for help- 
ful conversations. JMR acknowledges support from 
the Center for Advanced Security Research Darmstadt 
(CASED). 
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APPENDIX 

This appendix contains eight sections. The first shows that the relative entropy is asymptotically continuous. The 
next four sections discuss in detail the state transformation protocols for the case of two level systems. Section II 
presents a distillation protocol for diagonal states, while section III describes a formation protocol also for diagonal 
states. The following two sections extend these protocols to the case of arbitrary nonstationary two-level resources. 
Then in Section VI we outline how the results can be easily generalized to higher dimensions by considering as an 
example the distillation protocol for diagonal states. Section VII discusses some characteristics of the exhaust states 
produced in these protocols. Finally, Section VIII discusses the equivalence of our formulation to other models of 
thermodynamics and the degree of control one needs to implement our thermal operations. 



Extensivity and asymptotic continuity 

To show that D {p\\j) is asymptotically-continuous, we make use of the following, from 
Proposition 2 Suppose a function f satisfies (1) "approximate affinity" 

\pfip) + (1 - P)fi^) - fiPP + (1 - pW))\ < c (7) 

for some constant c > any < p < 1, and (2) "subextensivity" f{p) < Mlogd, where M > is constant and 
d = dim('H) for % the state space on which p has support. Then f is asymptotically continuous, 

\f{pi)-f{pi)\<M\\p,-p2\\ilogd + Ac. (8) 

The entropy relative to the Gibbs state satisfies both conditions. To see the first, let p ^ '^i^PkPk for some arbitrary 
density operators pk and a be another arbitrary density operator. Then 



D{p\\a)=TT 



^ Pk [pk log Pk - Pk log cr + pfc log p - Pk log Pk) 



(9) 



= Y^pkD ipkWa) +Y,PkS{pk) - S{p). (10) 

A; fc 

Since S{p) < J^kPk^iPk) + H{pk) and the relative entropy is convex, this implies 

< Y^PkD ipkWa) - D {p\\a) < H{pk). (11) 

k 

In the present setting this means 

pD {p\ |7) + (1 - p)D ia\ \^)-D{pp+{l- p)a\\j) < H^ip) < I, (12) 

where H2 is the binary entropy function. Furthermore, D {p\\^) is approximately extensive if the maximum energy of 
the system is extensive. First, note that D {p\\j) = ^Fplp) — /3Fp{-y), for Fj3{p) = {H)p — ^S{p) is the free energy. 
Thus, the maximum of D {p\\'y) occurs for p ~ |i?max)(£'max| where l-Emax) is the eigenstate of maximum energy. 
Direct calculation shows 

D (|^,„ax)(^max|||7) = Tr [| S„,ax) (^max | (log | ^.^ax) (^max | - log7)] = -(^max| log7|Smax) (13) 

= /3i^max + log Zp = /3i;„,ax + log ^ C^^^" < ^E,^,^ + log d. (14) 

k 

Here we have assumed that the energy values Ej > 0. When the maximum energy is extensive, i.e. l^max < Klogd 
for some constant K, we obtain D (|-E'max)(-£'max|||7) < Mlogd for M = f3K + 1. 
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Distillation of diagonal states 

For simplicity of presentation we consider qubit systems with the Hamiltonian given by H ~ where sum 

runs over all involved qubits. We start with I copies of the Gibbs state r and n copies of resource state p, where 

p=(l-p)|0)(0|+p|l)(l|; r = (l-q)|0)(0|+<z|l)(l|. (15) 

with q = e^^ I [1 + e^^) and (3 the inverse temperature, which we take as a constant parameter. The aim is to obtain 
the maximal number of copies possible of qubits in the pure excited state |1) by a unitary that commutes with H and 
partial tracing. 

T®^ ® p®"" ^ a'^''^ (16) 

We denote R = ^ (the rate of distillation) and e = j (the ratio between number of used Gibbs states and resource 
states). The Gibbs states are free, so we accept that e asymptotically vanishes. 

In the protocol we shall use the fact that up to a small error (vanishing for a large number of qubits) 

(17) 

t 

where t run over strongly typical types, i.e. the types containing strings with the number of I's within the interval 
(np — 0{^/n), np + 0{^/n)), and Pt denotes the projector onto type t. Similarly 



^9tQt (18) 



again with qt « qn. The errors in both approximations is smaller than 2""''"*" when quantified by the trace norm. 

For simplicity we shall first pretend that both r*^' and p®" consist of a single type. Then further we will show how 
to extend the argument to a mixture of types. 

So we start with a tensor product of two types (one from Gibbs, the other from p), i.e. an equal mixture of strings 
of length I + n. The string consist of two substrings: the first has ql I's and the second has pn I's: 

I n 



000...0 ii_^oo...o ni^. (19) 

Iq np 

There are roughly 

2iHiq) ^ 2"«(P) (20) 

of such strings (with the error being a multiplicative poly(n) factor). 

We now apply unitary transformation to these strings mapping them into strings of the same total length which 
have m I's to the right: 



000 ... 00 ... 111^ ^ 

Iq np 

00000... 0000 111... 11 111... 1 (21) 



where 

k = m + n- I (22) 

(conservation of dimension), and r and m are about to be determined. First, r is fixed by conservation of energy, 
which requires that the number of I's is conserved: 

Iq + np = rk + m (23) 

with k = n + I — m. Then unitarity requires that there are at least as many strings of length k with rk I's as the 
number of initial strings (|20p : 

2kH{r) > 2^H{q)+nH{p) (^24) 
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Roughly speaking this is conservation of entropy. Using (|23p and (|24p we obtain that our transformation is possible 
if 

H{q) + eH{p)<{l + e-Re)H{^±^^^), (25) 

1 + e — en 

where recall that e is the ratio of Gibbs states used, and R the ratio of pure excited states obtained. We now expand 
this with respect to e to first order and let e — >■ This means that we take much more Gibbs states than the resource 
states, and it says that we work with an infinite sized heat reservoir (i.e. much larger than our system). As a result 
(recalling that q = e^^ /{I + e^^)) we obtain that the following rate can be achieved 

H{q)~Hip) + l3ip-q) ^ Sip\\T) 
- H{q)+(3{l-q) 5(|l)(l|||r)' ^ ' 

i.e. the protocol achieves the upper bound obtained by the monotonicity argument in the main text. 

So far we worked with a single type. But our initial state is actually a mixture of products of types Qt ® Pf ■ We 
thus apply the protocol separately to each type, with the same number m of required output excited states, for all 
types, with this number being fitted to the product of less numerous types (i.e. the one with smallest number of 
I's, i.e. {np — 0{y/n)){lq — 0(Vl)) I's). Note however that the tails will disappear asymptotically, as we divide the 
equations by I. Also the approximation to the number of strings in each type by the the exponential of the entropy 
is correct up to multiplicative polynomial factor, which is also irrelevant asymptotically. 



Formation of diagonal states 

We are going to construct the formation protocol in three stages. The first is to show that for a particular type Tq 
of the I copies of the Gibbs state, we can create a particular type Tp of the state we want to form. We then show 
that we can do this for all types of the Gibbs state. Finally we show how to correctly get the distribution over types 
of the target state. 

We shall need the following useful lemma: 

Lemma 3 (Birkhoff primitive) The following operation can be done by means of thermodynamical operations with 
arbitrary accuracy: 

P~>^PkUkpUl (27) 
fc 

where pk is arbitrary probability distribution, and the Uk commute with Hamiltonian. In particular, a random permu- 
tation of the systems is a valid operation. 

Remark. The accuracy depends on the number of Gibbs states we will use, but in our paradigm they are for free. 
Proof. First let us note that the following unitary transformation preserves energy: 

^\i){i\®U^ (28) 

i 

provided that |z) are eigenvectors of the Hamiltonian and the Ui commute with the Hamiltonian. To obtain the 
required transformation we will take I copies of Gibbs states. Let qi denote the probability distribution of single 
strings. Clearly qi < qK We now divide the set of q^'s into groups, such that within each group they sum up to the 
required pk 's from (j27p . This can be done with arbitrary accuracy, by taking I large enough. Then within each group 
we set Ui = Uk- □ 
We want to form n copies of the state p = (1 — p)|0)(0| from a pure excited state. Let us first show how 

we can form any of the typical types of the state. 

Formation of a msLximally mixed state over a fixed type. 

Consider a fixed type Tp of the n systems we want to create, and let it be one with np I's. For other types, the 
reasoning is the same and the asymptotic rate will be the same. We start with I copies of Gibbs states r, and m 
copies of excited state |1). We consider a final exhaust system of k systems. Consider a particular typical type Tq of 
the Gibbs state with Iq I's. In that type, there are « 2'^'''^ strings up to some 2^^'-'^'> factor. We want to map these 
initial strings onto the final strings in the type Tp as follows. Take {ui}i to be the strings in Tp and for each Ui 



Iq I's m I's np I's kr I's 

FIG. 1. Strings mapping in formation protocol 

consider some set {vj}j of strings on the exhaust system. We now map each of the initial strings to some string UiVj. 
This is illustrated on figure □ 

For each i, we can take the number of strings {vj}j to be the same or off by 1, simply by assigning the strings in 
an order determined by fixing j = I, then incrementing the i register until i = N, then incrementing the j register by 
1, reseting i to I and again increment the i register until i = N and repeating. This is all done to ensure that when 
we trace out the exhaust system, we get an even mixture over permutations within the type class. 

We can now use the analogues of equations (|22p . (|23p and (|24p to ensure that we can perform the unitary which 
implements this mapping: 

m + l = n + k (29) 
Iq + m = rk + np (30) 

2iH{q) < 2'=^('~)+"-f^(p) (31) 

We now take / oc m" with 1 < a < 2 and do as before. We take a > 1 so that we can take e = m/l small, and 
& < 2 so that Vl is sublinear in m and we can ignore such terms. 

This maps type Tq of the I Gibbs states onto the type Tp of p*^". We can map each of the initial Gibbs types on 
to Tp in this manner using a unitary Upq. For each such mapping, the above three equations will change, but only by 
some y/l factors which wc took to be sublinear in m. We can thus choose m to ensure conservation of energy in the 
worst case of Eq. ((30|) . and kH{r) is chosen to ensure the inequality Eq. ([31]) in the worst case. 

We now need to implement Upq conditioned on the initial type Tq. Since the typical initial types are on orthogonal 
and diagonal subspaces, we first do a conditional copying of the type class q onto an initialised register. We then 
act Upq conditioned on this register. Since the number of types is polynomial in Z, the register only needs to be of 
size logZ, and thus this resource does not matter as it is sublinear in m. It is an interesting question whether the 
formation protocol can be made to work without this subliear supply of pure states. 

Let us call this unitary Up which creates a particular type Tp. To get the distribution over types, we simply use 
the Birkoff primitive of Lemma [3] to implement \p)ip\ ® Up. This is irreversible, but since the number of typical 
types is polynomial in n, the rate of entropy that is created by this procedure is negligible, i.e. logarithmic in n. It 
is not hard to see that Eqs. (|29ll3ip give the required rate (i.e. the inverse of the distillation rate). 

Distillation of arbitrary states 

We now extend distillation to the case where our states are not diagonal in the energy eigenbasis. 

Consider a state p — + (1— p)|02)(02|. The average energy of the state is {E) = p|((/)i|l)p + (l— p)|(02|l)p. 

As before, wc consider n copies of p and I copies of systems in a Gibbs state r. Regarding p®", only the blocks with 
energy E G [n{E) — ^/n,n{E) + ^/n\ will be relevant, i.e. we have 

> 1 - 2-°(") (32) 
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where the sum runs over E G [n{E) — 0{y/n), n{E) + 0{y/n)], with Pg the projector onto the energy E eigenspace. 
(this follows from Eq. (|47p . proven in Section p). 
Our protocol has two stages: 

(i) unitary rotation within energy blocks of a resource system (consisting of n qubits) solely. 

(ii) drawing work by string permutations on the total system resource (with n qubits) plus heat bath (with I qubits) 

We write down the resource state in the energy eigenbasis. As said above, only blocks with energy « nE will appear. 
We will use the fact that the state is, up to exponentially vanishing error, equal to its projection onto the typical 
subspace, having dimension 2"'^('')+'-'(v^) where S{p) is von Neumann entropy of p. Therefore, within every block the 
rank of the state is not larger than k, 2"'^ (as a projection cannot increase the rank). 

Now stage {i) is the following: within each energy block, we apply unitary rotation, which diagonalizes the state 
restricted to the block in the energy basis. Then there is stage {ii), in which we apply the protocol of distillation of 
diagonal states as in Section „ i.e. we permute strings in such a way that the output strings have m I's to the right. 
Such protocol produces m systems in a pure excited state, (note that all coherences initially present in the state are 
now left in the garbage). Using the same notation as in Section „ for a product of two single types, e.g. with Iq and 
n{E) l"s, respectively, the contraints now become 

k = m + m — I 
Iq + n{E) = rk + m 

2kH{r) > 2'-H"('?)+"'S'(rt 

As before, taking the limit j — )- we obtain that any rate R is achievable, provided it satisfies 

H{q)-Sip)+P{{E)-q) ^ Sip\\T) 

H{q)+l3{l-q) ^(|l)(l|||r)- ^^^^ 

Thus also for nondiagonal state, we can reach the upper bound given by relative entropy distance from the Gibbs 
state. 



Formation of arbitrary states 

We now show that we have reversibility even in the off-diagonal case, if we allow a sublinear amount of superposition 
over energy-eigenstates, which is a resonable assumption since the rate at which this is consumed vanishes in the 
asymptotic limit. This is very similar to the fact that in entanglement theory, distillation requires no communication 
but formation requires a sublinear amount of it. The reason is also the same and in entanglement theory is known as 
entanglement spread 0-0]. Here, distillation of work requires no superposition over energy eigenstates, but formation 
does. 

Generally, say we want to implement some unitary 



(34) 



which does not conserve energy. Introduce some reference frame state 

\H)=J2f{h)\h) (35) 

and instead implement 

W"'" = J2 {E,\<E>\h- E, + E,){h\ . (3g) 



Then if we act this on a state 



ies 



(37) 



with S such that \uij\'^ is small between states with large \Ei — Ej\, the reference frame state will not be disturbed 
too much and we can take /(/i) to have small support i.e. we do not need a big superposition. This will be the case 
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here, since on the typical subspace, the variation in energy is subhnear in the number of copies of the state we want 
to create. 

To see how this works, note by way of example, that if in Equation (f55|) . we take f{h) to be 1/\/N for energies 
Ej = J, j ~ I...N and ,f{h) = otherwise, then removing a unit of energy and adding it to another system, does not 
change the state of Equation much. i.e. the inner product between \H) and J^h \ ^ ~ approaches 1 



N 

E 

h=l 



N-1 



l/VN{h\ l/VN\h) = 1-1/N 



(38) 



/i=0 



which approaches 1 for large N. State like that of Equation (|35|) therefore allow us to lift the superselection rule of 
energy, without being consumed much in the process. 

This gives some insight into embezzling states 0, which is a resource often used in entanglement theory in similar 
situations. E.g. one can use a state similar in form to Equation ([35]) 



\E) = j2fikM)TBm 



<g>in-k) 
AB 



(39) 



which is a superposition of a different number of entangled EPR pairs \4>)ab ■ As stated previously, these states can be 
used to implement operations which require entanglement spread. Just as removing one unit of energy, doesn't change 
the state of Equation (|35p much, likewise, removing one EPR pair from the state of Equation ((39|) and adding it to 
another system, doesn't change that state by much. We can embezzle energy, just as one can embezzle entanglement. 
We therefore see that a superposition over some resource can create an embezzling state for that resource, and will 
allow us to lift some superselection rule or restriction. 

With this small superposition over energy states, let us now show we can create an arbitrary state at a rate given 
by the relative entropy distance to Gibbs states. Let p := p\(pi){(j)i\ + (1 — p)\(j)2) {<f>2\ and 



with 



for TTg a permutation. 

The idea of the protocol is as follows: we will first create a diagonal state 



Pk\tk,Sg){tk,Sg 



(40) 



(41) 



(42) 



which has the same spectrum as p**" and where each eigenstate has the same average energy as an eigenstate in the 
typical subspace of p^". From the result of the previous section it is not hard to see that this can be done at a rate 
given by the relative entropy distance of p to the Gibbs state, since in the limit of many copies the regularised relative 
entropy distance is the same. We would then like to rotate the diagonal basis to the ^ffc^s-basis. This cannot be done 
by unitaries which commute with the Hamiltonian unless we allow for a reference frame \H) which is a superposition 
over energy states. We then want to show that the reference frame which allows us to break the energy superselection 
rule is consumed at a vanishingly small rate. We do so by showing that the reference frame superposition is over a 
size sublinear in n. This can be understood as coming from the fact that in the typical subspace, the superposition 
over different types is sublinear. 

We consider only typical \'^k,g) with k € Typ^ := [np — ^/n, np + ^/n\. Then 



Let also 



I* 



k.g) 



(43) 



(44) 



where \t',s') is an eigenstate of the Hamiltonian with energy t' (s' labels the degeneracy). From Eq. ((4T|) it follows 
that the sum in Eq. (|44|) will be peaked around only a few energy values t' . Indeed, with 



|0i) :=a|0)+&|l). 



(45) 
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and 



\(t>2) :=fe|0)-a|l), 

set Typ := [nEt - ^/^,nEt + ^/^, where Et := {{n - t)\b\'^ + t\a\'^) /n. Then 



t'^Typj.s' 



(46) 



(47) 



Note that since Et := ((n — t)\b\'^ + t|ap) /n the degeneracy of each energy state \tkgs) is at least as large as the 
degeneracy of l^'^-s). 

Now we construct the reference frame. Let \w) be an energy eigenstate with energy n(p|6p + (1 — p)|ap) — n^/^. It 
is needed to pad the dimension of the reference frame, since although the probability that it happens is vanishingly 
small, the unitary does connect states with large energy difference. After the protocol, we will see that \w) will hardly 
be changed, and thus is only used as a catalyst. We define the reference system as follows 



\H) 



1^1 hen 



with \h) := \h') (g) \w), where|/i') is an energy eigenstate of energy h' and H := {0, 2n^/^}. 
Consider the energy preserving unitary 

E C%\t\s'){U,Sg\®\h + t-t'){h\. 



h.t.s.t's' 



Then in the sequel we prove that 



U[ E Pk\tu.Sg){tk,s,\®\H){H\\u^ ~p'^^^®\H){H\ 

\feeTyPp,s 

< 0{n-^/^). 



We first analyse the action of U in \s,t) ® \H): 



where the non- normalized pure states are given by 



t'STypj.s' 



(48) 



(49) 



(50) 



(51) 



(52) 



with 



and 



1^2):= E 4Ut',s') ^Icrrr 

t'STypj^s' 



|err,,) :^ ^ ^ |/, + t - - l^> 



1-3):= E 



t'^Typj^s' 



(ml-/''-" 



(53) 



(54) 



(55) 
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Set ifc = Ek and let us take Sg = g. We can do the latter since as we mentioned, the degeneracy of \tk, Sg) is larger 
than the degeneracy of \'^k.g)- Then, 

\\U{\tk,Sg) ® \H)) - ® \H)\\ < WW,) - Ivf,,,) ® \H)\\ 

+ \\W2)\\+\\Wl)\\. 

We now show that the three terms in the R.H.S. are small. For 11^2) we first note that for t' G Typ^ 



|errt')|| < n' 



-1/6 



by taking the worst case. Then 



For Ws), in turn, we have 



l^2)f= E l^*'.'ni|cnv 

< max |l|errt')||^ < n"^/^. 

i'eTyPt 



t'^Typ.s' 



Finally, for 



\\W,)-\^,,g)^\H)\\ = 



E C%\t',s')-\^,.g 

t'GTypj^s' 



From Eq. (|56|l it thus follows that 

||C/(|t,,s,) ® - 1*,,^) ® \H)\\ < 0(n-i/6). 
Since - 14') (Mi < V^IIIV') - 10)11 for every two states {ip), \<p), we find 

\\U{\tk,Sg){tk,Sg\ ® \H){H\)U^ - l^kji^kj ® \H){H\\\^ 

Eq. ([50)) then follows from the triangle inequality for trace- norm and Eq. 



(56) 
(57) 



(58) 



(59) 



(60) 
(61) 

(62) 



Distillation of quasiclassical states in arbitrary dimensions 

In this section we present the details of the distillation protocol for stationary, or quasiclassical, states for the 
general case of d-dimensinal systems. This is presented as an example of how the results can be extended to arbitrary 
dimensions by very similar arguments to the two-dimensional case. 

The input to the protocol consists of n copies of the initial resource p and £ copies of the Gibbs state 7 of the same 
Hamiltonian H. Since the states are quasiclassical, the overall state of the input is fully described by a collection of 
strings s S {0, . . . ,d— 1}"+^ listing the energy level occupied by each system, each string weighted by its probability 
of occurrence. Here d is the total number of energy levels of H, and the first n entries of s correspond to the state 
of p and the remainder to 7. If some of the energy levels are degenerate, we simply work in the eigenbasis of p to 
remove the degeneracy in labeling. If even that proves insufficient, we are free to make any choice we like among 
the remaining degenerate levels. Because permutations within each of the two substrings do not change the overall 
probability, we can therefore instead work with the collection of occupation frequencies f of the state, which describe 
the number of systems in the ground, first excited, second excited states and so on (divided by the total number of 
systems) , again each weighted by an appropriate probability. 
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We would now like to define a protocol which creates as many standard resources in the form of work as possible. 
In the qubit case the standard resource had a very simple form, namely the excited state of the Hamiltonian. Here, 
however, the setup is more cumbersome, as there are d— 1 excited states and no guarantees that their energy differences 
are in any way commensurate (so that as, e.g. in a harmonic oscillator, the energy of the state |2) could be transferred 
to two instances of the state |1)). To handle this issue most simply, we imagine that, in addition to the resource and 
thermal states, we also have a work system at our convenience. The work system is capable of accepting arbitrary 
amounts of energy, i.e. it has energy transitions which precisely correspond to those of H, but it cannot accept any 
entropy. Now the goal of the protocol is to change the occupation of the energy levels so as to transfer as much energy 
to the work system as possible. 

Let us now restrict attention to a fixed occupation frequency fp of the resource and f-,, for the Gibbs state. We will 
later design the protocol so that it works for every such frequency pair which has appreciable probability. Suppose 
that we now change the occupation numbers by an amount described by the vector — nx (whose prefactor is chosen 
for later convenience). This results in a new occupation vector v> defined by {n + t)v> = nip + ££y — nx. For this to be 
an allowable transformation in our framework, this mapping must satisfy two constraints: energy conservation and 
unitarity. In contrast to the qubit case, here the input and output dimensions are equal by design. 

Energy conservation is simply enforced by requiring the work system to take up the change in energy of the 
input systems. Using the vector H to describe the energy of each energy level, the initial energy is given by Ei^ = 
nH • ip + in ■ £y while the final energy is Eo^t = nH ■ + • f.^ — nH • x. Energy conservation is then the statement 
that the work extracted is given by W = Ein — Eout = nH ■ x. 

Unitarity is enforced by making sure that the total number of configurations (strings) consistent with each occu- 
pation vector is conserved by the process. The total number of possible input strings in this case, iVjn, is just the 
product of the multinomial cofficients using the frequency vectors: 

n' £' 
(n(fp)o)! • • • (n(fp)d_i)! (£(f^)o)! • • • (^(fy)d-i)! 

The maximum number of strings TVout — M((n + i)i>) which can be created in the n + £ systems given the new 
occupation frequency v is the multinomial coefficient of the new occupation frequency vector, 

(n + £V 

iVout = M{{n + £)u) = (64) 

({n + £)iyoy. •••((71 + ijiyd-ir- 

Therefore, a sufficient condition for unitarity is A^in < A'out, or M{nip)M{£i^) < M{{n + £)i'). 
It can be shown that the multinomial coefficients obey the bounds 

e 1 ^nH{f) < < " 2"^W, (65) 



and therefore M{ni) « 2"^(^)='='^('°s"). The unitarity condition then becomes 

ni?(fp) - 0{\ogn) + £H{^^) - 0{\ogi) < {n + £)H{v') + 0(log{n + £)) (66) 

Defining e = j wc may express this as 

eHiip) + H{{,) < (1 + e)HH + 0(1^). (67) 

Using the expression for v above and assuming that e <C 1 gives 

, . / nf„ + — nx \ 

= H (68) 



n + £ 

= F(f^) + e [(f^ + X - fp) • 1 - H{i^) + (x - fp) • logf^] + 0(e2) (69) 
= H{i^) - e (fp - x) • logf^ - eH{L,) + 0(e2). (70) 

Here 1 is the vector of all ones, and we have made use of the fact that f • 1 = 1 for any frequency vector f , which also 
implies x • 1 = 0. Altogether we obtain the relation 

-x^logf^<i^(fp||f^)+0(i2f^). (71) 
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The next step is to fix the protocol to the worst case among the likely frequency vectors fp and f^. Their probabilities 
sharply peaked around the individual distributions p and 7, respectively. Specifically, fixing an error parameter 5, 
the probability that ||fp — p||i > (5 is less than a quantity of order e""'' . Thus we can choose e = O(^) and still be 
sure that the particular frequency strays more than a distance e from p with only a small probability. Even in the 
worst, but still probable case we have 

-x.log7<i5(p||7)-0(^). (72) 

Now log 7 = — /3H — llogZ, so this condition becomes 

/3H.x<i?(p||7)-0(-^). (73) 

This equation gives the minimum amount of extractable work among all the likely frequencies, which is taken to be 
the target amount for the process. As the extraction is unitary for each frequency, and these correspond to disjoint 

quantum states, we can thus find a unitary for the entire input capable of generating D{p\\'y) — 0(--^) units of 



useful work per input resource state, with probability greater than 1 — 0{^^). 



Structure of the exhaust state 

When doing a transformation of p®" into cr®™, in the end of the protocol we actually obtain cr®™ (g) ttj. and we 
trace out tt^, which lives in fc = f2(n) copies of system. Although 7r„ is usually far away from many copies of a Gibbs 
state, in fidelity, we show its reductions are very close to a Gibbs state. The main observation is that because 7r„ 
should be useless for extracting more copies of cr at a non-zero rate, we must have 

S{'Kk\\pf)<k'~\ (74) 
for (5 > 0. But by by subadditivity of the entropy we have 

k 



1=1 

k k 

>-Y^S{^k,i)-Y.^r{pu,i \ogpp) 
1=1 1=1 

k 

:^'^S{TTk,l\\pp), (75) 

1=1 

where iTkj '■= Try(7rfe) is reduced state of tt/j obtained by partial tracing all the systems except the ^-th one. Let us 
assume for simplicity that all TTk,i are the identical. Then 

S(^fc,i||p/j) < fc-^ (76) 

which by Pinsker's inequality implies 

hk^-P!3\\i<n{k-''). (77) 
More generaly, repeating the same argument for larger blocks we get that 

||Tri,i+i,...,fc(7rfc)-pf^|li<l](Lfc-2*). (78) 



Equivalence and degree of control for thermal operations 

Here, we address two questions. The first is how our paradigm, where we use unitaries V which commute with the 
total Hamiltonian H, relates to other approaches. The second is how much control an experimenter needs over the 
choice of unitaries V. To answer the first question, consider a common approaches to thermodynamics, which is to 
manipulate thcrmodynamical systems using an external apparatus. In this model, the systems are manipulated using 
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a time-dependent Hamiltonian, H{t). Another approach is to add an interaction term Hint between various systems 
we are trying to manipulate (e.g. the resource, and the heat bath), and then bring these systems in contact. Let us 
now see that these are equivalent to considering unitaries V which commute with the original Hamiltonian H. 

First note, that in the case of a time-dependent Hamiltonian, we can simply include the clock as one of our systems, 
so that H{t) becomes H{T)+Ilr with [r, H,-] = —i. r then evolves like a clock, as can be seen by solving the Heisenberg 
equations of motion to get T{t) = t. Thus H{t) = H{t), however, we conserve energy in this picture. We thus can 
go from a picture with a changing Hamiltonian, to one with a fixed one. This model is thus equivalent to the one 
considered here, with fixed Hamiltonian. 

Likewise, in the case where an interaction term is added, we can take the total Hamiltonian to be Htot ^ H + Hint 
and assume that initially, {H + Hint)\ip) ~ H\ip) i.e. the systems are initially far apart. They can then evolve 
unitarily, such that the systems interact, and then move far enough apart that the interaction terms are negligible 
again. In such a picture, an eigenstate of the initial Hamiltonian H, will evolve into an eigenstate of H with the same 
energy (by conservation of energy, and the fact that the interaction is negligible at initial and final times). Thus, all 
that happens here, is that eigenstates of fixed energy evolve to other eigenstates of the same energy, and this can be 
accomplished by means of a fixed Hamiltonian H and a unitary V which commutes with it. We thus see that also the 
picture of adding interaction terms is equivalent to having a fixed Hamiltonian H, and operations V which commute 
with it. 

Let us now turn to the second question. It might appear that an experimenter who wished to implement our 
protocols would need to very carefully manipulate all the many degrees of freedom of the n systems and the heat 
bath. However, this is not the case, as we will now see by taking distillation of work as an example. There, we were 
mapping eigenstates which had a type Iq on the heatbath r, and pn on the resource p to microstates which had type 
rk on the garbage cr, and m I's on the work system. However, although for any implementation of the protocol, 
we need a particular mapping of strings (i.e. microstates) of these initial types, to strings of the final type, any 
mapping will do. The only important thing which is required is just that the unitary operation map the initial types 
to the final types. Thus an experimenter who wishes to implement the protocol, does not need fine-grained control 
over the mapping of microstates within one type to microstates within another type. She only needs to know that 
the unitary maps one type into another. I.e. there are an exponentially large number of possible implementations 
of our protocols each of which map particular strings within the initial types to particular strings in the final types. 
However, it doesn't matter which implementation is chosen, and the experimenter thus does not need the fine degree 
of control of the particular implementation. 

We can think of the type as being like a macroscopic variable such as the total magnetisation of many system, 
or total energy (indeed it is the latter). In the distillation protocol, we map the macroscopic variables of energy 
on two large systems (r*^' and p*^") to the macroscopic variable of energy on the final system. Any unitary which 
accomplishes this, will successfully implement our protocol. Thus, the experimenter only needs control over the 
macroscopic variables, not the microscopic ones. 
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